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1 . INTRODUCTION 


Remote sensing and parameter optimization are two active 
space-related research areas. The purpose of this contract 
was twofold: 

(i) to present to the Mission Planning and Analysis 
Division a short course on the basics and state-of-the- 
art of remote sensing; 

(ii) to analyze recent developments in parameter 
optimization and determine their implications with 

i 

respect to on-board guidance. 

In Section 2, the format of the short course is outlined. 
In Section results on parameter optimization are presented. 
The Fletcher and Broyden parameter optimization techniques are 
described and compared with the Davidon-Fletcher-Powell (DFP) 
method. Both of these methods have been built into the 
NASA-MSC PEACE parameter optimization program. In Section Zf 
the Johnson-Kamm parameter guidance scheme is discussed and a 
method for computing the feedback gains with a single numerical 
integration is presented. In Section 5 conclusions and recom- 
mendations for future study are presented, with an emphasis on 
the status and future of parameter optimization based on-board 
guidance . 
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2 . . REMOTE SENSING 

A short course was presented during December 1971 through 
February 1972. The lecturers were members of the University of 
Michigan Willow Run and High Altitude Engineering Laboratories. 
The format of the course was as follows: 

1st and 3rd Weeks: Basics of Remote Sensing and The User 

Community . Fundamentals and definitions of remote sensing, 
user's needs (e.g., agronomists, resource managers, environ- 
mentalists, meteorologists, government agencies); basic 
mathematics and physics. 

2nd Week: Multivariant Spectral Analysis . Relevant mathematics 

and physics review; retreval of spectral, spatial, and temporal 
parameters; underlying principles of pattern recognition. 

Ath and ?th Weeks: Advanced Mathematics and Physics of Remote 

Sensing . Physics of spectroscopy, propagation, absorption, 
scattering, radiative transfer, geometrical and physical optics, 
and physics of sensing. Mathematics associated with the physics 
basic probability and statistics, Fourier series and transforms, 
and numerical techniques. 

5th Week: The Atmospheric Environment . Basic physics of the 

atmosphere, meteorological measurements from space vehicles, 
atmospheric parameters pertinent to environmental problems, 
circulation, sources and sinks for atmospheric pollutants. 

6th Week: Imaging Sensing . Classification of passive and activ 

sensors. Passive: multispectral scanners, infrared scanners. 
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Active: high-resolution radar. Characteristics of the sensors, 
data reduction, error sources, typical results. 

8th Week: Nonimaging Sensing . Fourier transform spectroscopy, 
filter radiometry, microwave spectroscopy. Characteristics of 
the sensors, data reduction, error sources, typical results. 



3. PARAMETER OPTIMIZATION 


In Refs. 1-3, shuttle ascent trajectories are optimized 
by representing the steering angle rate as a sequence of 
straight line segments, and then applying the DFP parameter 
optimization technique . Eventually parameter optimization may 
be used on-board in the determination of steering commands. 


If so, then one should attempt to develop schemes which, do not 
require an extensive 1-D search. One of the goals of this 


contract was to determine the relative performance capabilities 
of the DFP method and a modified Fletcher's method, which 
does not require an extensive 1-D search. In addition to this 
comparison, a relatively new method due to Broyden^ which 
requires a 1-D search was also considered since it is closely 
related to both the DFP and Fletcher methods. Both of these 
techniques have been built into the NASA-MSC PEACE program. © 

3 • 1 The Parameter Optimization Algorithm 

Consider the minimization of the differentiable real- valued 
function- 


f (x-j ’ • • • > X^) • (3 • 1 ) 

All of the iteration schemes of this report utilize update 
formulas of the form 


,(k+1) v (k) 


x"~ ’'= x'”' - ot k H k g 


(k) 


(3.2) 

where x^ ^ current value of the vector x, •=- new 

value of x, a k a scalar parameter (the 1-D search parameter), 

H k an nxn matrix which is updated on each iterate, g^ k ^= f (x^) 


the gradient of f evaluated at x 


(k) 


A particular scheme 
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is defined by the way that it updates Hj and cc^. First the 
algorithm will be stated, and then the underlying theory will 
be discussed in Section 3-2. A flowchart of the scheme is 
given in Fig. 1. The notation A( 3^ =- C is 

employed below. 

(1) Specify x Q , a Q , E q , /jl . Calculate f Q = f[x Q ] ,g 0 =g[z o ] ; 

set J=0. (H is an arbitrary symmetric, positive 

definite matrix and a > 0.) 

o 

(2) Calculate f(j + -])i = f[x._ - a j-j HjSjl > where ccj.j is the 


current estimate of «j, and check f ( j.j- •] ) i < fj* If 
yes, go to (3) if «j-| =1 or go to a crude step-size 
increase package if «j-j - r 5 1; if no, go to a crude 
step-size decrease package. The resultant step-size 


is denoted by «j. 

(3) If J=0, go to (3). If J>0, check 

If yes, go to (-4); if no, decrease a j until the 
inequality is satisfied and then go to (A) • 

(4) Check !0 2 3-/ AX 3 - < ^O'T-I AX^ * ' 

If yes, go to (5); if no, increase tij until the 
inequality is satisfied and then go to (3) • 

(3) Calculate Xj + ^=Xj - «jHjgj and gj + -j • Check 

^ O .If yes, go to (6). If no, 

increase cxj. 

(6) Check ^ 

If yes, go to (8); if no, go to (7)* 




(7) 


Calculate : 



h t + 


AKt &Xj- 

A (j T 


A§j AQj- M-p 

A $;r 


Go to (9) • 
(8) Calculate: 


(3-5) 


^vX-fi — Mj- 


AXj-A^x &r H- 

A; V A o^‘ Ax j’ rA ^- 



(i + v 
V AX^Ag.3- A 


AK t A A \ 
ax^agt J 

O <Jv) 


(3. k) 


Go to (9). 

(9) If a j < 1 , set Oj^i =ot j 3 otherwise, set ccj + .j= 1. Set 
J = J+1 and go to (2) . 

From the algorithm above one can see that a T =1 is the 

O 

desired value of the stepsize, and in the terminal iterations 
of the scheme a j — p~ 1 if the scheme is behaving like Newton’s 
method as desired. Fletcher^ bases most of his discussion on 
the ex- = 1 case and devotes little attention to the ctj =£= 1 case . 
In the trajectory optimization problems of this report, the 
«j rt 1 case occurs more often than not because of the difficulty 
of the problem and the use of finite difference formulas for 
the gradient calculations. Thus, more details about the a T =f 1 
case have been included in this section than in Ref. A. 

5.2 Theoretical Basis 

The algorithm of Section 3-1 is basically a scheme for 
choosing between two formulas for the II Tl , -matrix while 
preserving a reasonable stepsize. Either Eq. (3-3) or (5 • A) is 
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used to define H J+ ^ . Equation (3-3) is the classical DFP 
formula, a .rank- two formula. Equation (3*4) is also a rank- two 
formula which has been studied in its own right in Refs. 6 and 7- 
The fact that Eq. (3-4) is rank- two may be seen by rewriting it as 

h t . = (r - 3 ) fu(i- --43 ^- ) + 

J+i 3 1 - V kxgt^'' (3-5) 

In Ref. 6, Broyden shows that both Eqs . (3 3) and (3*4) are 
members of his one-parameter class of formulas introduced in 
Ref. 9 j and that both satisfy the "quasi-Newton property", 

Hj +1 AXj= Agj. Equation (3-3) results by choosing his p j- 
parameter to be zero while -Eq. (3*4) results if Pj“y(ASj AXj). 
Broyden noted that in numerical experiments comparing the use 
of Eqs. (3-3) and (3-4) separately and with a 1-D search that 
the algorithms had similar characteristics in the early stages 
but quite different characteristics in the terminal stages. This 
behavior is explained by the fact that Pj = 1/(Agj AXj) ma y be 
near zero in the early stages of the algorithm because the 

j T 

gradients may be relatively large (where j A g j A x j | 

gj+-] Av x j - Sj T A x j | = | Sj T A x j | in a quasi-Newton scheme 
which employs a 1-D search). Since Eq, (3-4) and a 1-D search 
for the DFP program were required in the simulations, it was an 
easy task to also obtain simulations of Broyden* s new method, 
i.e., Eq. (3-4) with a 1-D search. 

Before considering Fletcher's justification for the basic 
algorithm, mention should be made of the occurrence of Eqs. (3-3) 
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and (3*4) in Ref. 7* Since numerous updating formulas for the 

O 

H-matrix have been proposed in the past decade, Greenstadt 0 
considered the problem of choosing the "best" update formulas 
subject to appropriate constraints (e.g., symmetry and finite- 
convergence for a quadratic with a 1-D search). After investi- 
gating a number of performance indices, Greenstadt found that 
•the following optimization problem gave tractable results: 

rtlnimize : F( AHj) = Tr (V/AHjWAHj T ) (3.6) 

Subject to: A Hj^ = A Hj (symmetry), (3-7) 

A a gj = AXj - HjAgj, (quasi-Newton) (3-8) 

where Tr( ) == trace of ( ) and W is an arbitrary matrix to be 
specified. The expression -obtained for A Hj by solving the above 
minimization problem involves the arbitrary matrix W. Goldfarb*' 7 
found .that Vf^ = H J+1 results in Eq. (3*4) and W -1 = K J+1 - 
( Agj T AXj) (Hj Agj Agj T Hj) / ( a gj)^ 2 results in Eq. (3-3), 

the DFP formula. He also shov/ed that z^(AHj " AHj | Q )z > 0, 
where z — arbitrary n-vector, A Hj|i. •=. H J+ ^ - Hj in Eq. (3.4), 
and g Hj q s - Hj in Eq. (3*3) This means that Eq . (3-4) 

is less likely to tend toward singularity while Eq. (3*3) is less 
likely to tend toward unboundedness . Fletcher^ obtained a similar 
result by a different argument, and this forms the basis of his 
algorithm. 

Let us now consider Fletcher’s method.^ Denote the formula 
of Eq. (3-3) hy H q and the formula of Eq. (3-4) hy H^ . Let £ 
be a scalar parameter and define the linear combination 

~ (1-0)H q + ^ 


(3*9) 
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It is shown in Ref. k that if 0 e [0,1], then possesses the 
folio', Ting property: If f(x) is a quadratic function with 

G HL [ f x .V-] positive definite, then the eigenvalues of 

(Arranged in order) tend monotonically to one for any sequence of 
vectors ^x. (I.e., H^ tends to the inverse Hessian G“ in a 

certain sense.) Note that the property does not require a 1-D 
search. In addition to this property, it is shown that if 
[0,1], then H”^ may diverge from G. 

Since Eq. (3-9) represents an infinity of formulas, if it 
is to be useful there must exist a rule for selecting which value 
of $ c. [0,1] to use on a given iterate. Fletcher presents such a 
scheme by noting that a typical pitfall in the classical Daviaon 
method is the tendency of the updating matrix H to become either 


singular or unbounded. He shows that if 


0 > 0 


, then 


the eigenvalues (A 1? . . > A n ) of H^, H^/ (arranged in ascending 

order) are such that A;(0) > ,\ L (00 (i = 1,...,n), which 

implies H, — H^ j . . is "less singular" than H — H . , 

1 0 t p = 1 o — 0 0=0 

and H q is "less unbounded" than H^ . Thus, a simple test for 

nearness to singularity would indicate whether to use H q or H^ , 

which are the extreme elements of the class H^ , <<€[0,1]. 

Fletcher shows that 

m m rp 

0 = 0 Ag A x/ ( A g AX - Ag'HAg) 
defines the "rank one" formula 


(4 . *= 4. ( £ V 0 T - f-U- A AXj- - A 9 t ) 


( 3 - 10 ) 
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The interesting thing about this formula is that if Ag Ax>0, 

A . 

then 0 [0,1], and the formula does not restrict the 

eigenvalues of H in any way. Thus, one can use the rank one 
formula to indicate which value of ?*<={o,l| should be used by 
simply checking the sign of Ag Ax - Ag HAg; that is, if 

m . m rp . 

A g A x >0 is enforced, then Ag Ax - Ag“HAg>0 implies 

T T 

0 >1 (which means should be used) and Ag Ax - Ag HAg<0 

rp 

implies 0< 0 (which means H q should be used).' If AS Ax - 
T 

Ag HAg = 0, then is used to avoid singularity. Note that 
this test is step (6) of Section 3-1 • 

The only other steps in the algorithm which need to be 

discussed are steps (3) and (4) . Step (3) is a check to determine 

if the stepsize is so large that an unreasonably small decrease in 
the function is attained. That is, 

f J+1 = f J + S J T ^ X J + 0( ^ 2 ) „ (3-11) 

implies 

Afj/(gj T AXj) = 1 + 0(A). (3.12) 

T * 

If 0 <Afj/gj AXjk4 1, then the decrease in cost is unreasonably 
small with respect to the steepness of the gradient. 

Step (4) is a "filter" for the test 

' Ag/AX^>0. (3-13) 

It was noted in a number of simulations before the insertion of 
step (4) that condition (3-13) was violated. It is well known 
that if f is bounded from below, then there exists a larger value 
of a j which will cause the inequality to be satisfied, and in 
Fletcher's paper a scheme for increasing ctj is presented. However, 
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this scheme might result in numerous costly gradient evaluations. 
(In the problems of the next section, a single gradient is 
approximately as costly as fourteen to eighteen function evalua- 
tions.) Since gradient calculations are so costly, an approximate 
test had to be devised to avoid the calculation of more than one 

gradient per iteration, and step (4) is the result. 

T 

It v/as noted that whenever the ASj A.Xj>0 test was violated, 
T 

the value of gj a Xj was appreciably smaller than the value 
g J-l Ax J-1 


(two to three orders of magnitude smaller) . That 


T 

is, on successive iterates on which Ag Ax>0, the value of 
T 

g Ax was changing by zero to one-to-a-half orders of magnitude, 
whereas it changed by at least two to three orders of magnitude 
when the test was violated.' 

T 


Note that to cause 


gj AXj 


to increase toward 


S J-1 A X J-1 


, one need only increase the value of the search 

T 


parameter, which is the same remedy for the A gj AXj>0 violation. 
Thus, the following test was employed before the computation of 


1 0Ogj Zix j ^ ^ A. i* (3 • 1 4 ) 

T T 

i.e., if gj A Xj is at least 100 times greater than Sj_-j AXj_-j , 

T 

then the stepsize is increased and a decrease in g T Ax T is 

J 0 

T 

guaranteed. (Note that g Ax<0 is guaranteed on each iterate 

because of step (3)-) For all the shuttle computations this 

T 

test always detected the Agj AXj>0 violation without computation 
of g(xj + .j) for an unacceptable Xj + ^ - value. 

The test (3-1 A) has not been proved mathematically and it 
seems feasible that there exist cases when the test is satisfied 
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by A gj T AXj<0 and/or the tolerance value of 100 is unsuitable 
for other physical situations. However, A gj must 

computed in each iteration for the H- formulas, and thus, ohe 
A gj X AXj >0 inequality can always be checked and guaranteed. In 
any case, no more computation is required than in the original 
Fletcher's method since gj^AXj must be computed for other 
formulas in the method. 

3.3 Space Shuttle Trajectory Optimization 

A number of Space Shuttle trajectory optimization problems 
were simulated in the development of the algorithm, including 
three ascent problems and a reentry problem. A comparison of 
numerous algorithms for the stage-and-half configuration ascent 
problem are presented here along with partial results for a 
pressure- fed booster configuration ascent problem. •• 

The stage-and-half optimization problem involved eighteen 
parameters (azimuth adjustment parameter, payload, pitch angle 
at the time when engines dropped, and fifteen pitch rates), 
where payload is to be maximized. The optimization is from ten 
seconds after liftoff to orbital insertion (50 x 100 with inclina- 
tion specified) . The results for this optimization problem are 
presented in Tables 1 and 2. 

In Table 1 a comparison of DFP and the Modified Fletcher's 

method is shown for the case of a reasonably good guess for the 

T 

initial parameter vector. The relatively small value of g Hg on 
the fifty-second iterate of the DFP method indicates that the 
problem is reasonably converged on that iterate . Considering the 
fifty-second iterate of the DFP method as the converged solution, 
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four digit accuracy is obtained by DFP on the twenty-sixth 
iterate and by the Modified Fletcher's Method on the thirty-first 
iterate (with respect to payload and boundary condition satis- 
faction) . Since DFP requires more function evaluations and since 
a single gradient calculation corresponds roughly to eighteen 
function evaluations, the computing times to reach the twenty- 
sixth iterate in DFP and the thirty-first iterate in Modified 
Fletcher are approximately the same . As shown in Table 1 , ten 
more iterates are obtained for the Modified Fletcher's method in 
the same amount of computer time. However, DFP gets a lower 
value for the cost in the same amount of computer time, thus 
exhibiting better terminal convergence. 

In Table 2 a comparison of six algorithms is shown for a 
poor guess of the initial parameter vector. In the first col umn 
the gradient method (with a 1-D search) is included to. show 
the difficulty of obtaining good terminal convergence in this 
problem. The next two methods, DFP and Broyden, were the best 
performers with Broyden slightly better than DFP. Mote that DFP 
and Broyden give identical costs (to four digits) in the early 
iterates and then Broyden begins to get slightly lower costs; this 
is the same characteristic Broyden^ noticed. The last three 
columns show three methods which use only a crude search: Modified 

Fletcher, DFP with a crude search, and Broyden with a crude 
search. All three methods gave comparable results with Modified 
Fletcher obtaining the lowest cost in ten minutes computer time. 

All three H-formulas satisfy the main property of Fletcher's 
paper (i.e., **£[0,1]), and for this particular problem probably 



give similar results because the H-matrix remains well-behaved. 
Although these three methods are not better than DFP or Broyden 
(with searches) on this problem, they are appreciably better 
than the gradient method and yet do not require extensive 
programming . 

Table 3 shows an incomplete study of results obtained for 
the pressure-fed booster shuttle ascent problem. In this problem 
an element of the main diagonal of the H-matrix in the DFP method 
became appreciably smaller than the other elements of the main 
diagonal in the early iterates. This caused the 1-D search 
considerable trouble in obtaining a minimum, as noted by the 
large number of function evaluations (especially on the 3rd, 4th, 
and 3th iterates) . In this particular problem the Modified 
Fletcher's method performed better than the DFP method in that it 
required a considerably less number of function evaluations and 
obtained a lower cost value in the same number of iterates. Note 
how the Modified Fletcher method uses both of the formulas on 
this problem (i.e., Eq . ( 3 - 3 ) is used 6 times, Eq. ( 3 - 4 ) is used 
5 times). 

During the course of the study a number of observations we re 
made with respect to the performance of the algorithms and reports 
of their performance in the literature. These are summarized 
below. 

(1) The performance of the DFP method is strongly dependent 
upon the 1-D search used. In the early part of the study, 
the Modified F3.etcher method required approximately the same 
amound of computer time as DFP to obtain the same cost on a 
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number of different problems. Then a more sophisticated 
search v/as used in the DFP algorithm. The DFP method then 
became a much better performer. This explains how, in the 
literature, numerous algorithms are reported to outperform 
DFP, when with an efficient search DFP is clearly the better 
performer. (In Ref. Fletcher's method is reported to 
outperform DFP on a number of standard functions. However, 
when the two were compared with the NASA-MSC PEACE DFP 
program, DFP easily outperformed Fletcher's method.) 

(2) In a number of papers in the literature, little 
emphasis is given to the expense of computing gradients as 
opposed to function evaluations. For example, the IBM 
Scientific Subroutine 10 version of DFP calculates a gradient 
each time it evaluates the function. This calculation is 
not serious on low-dimension, test type problems, but it is 
extremely important when realistic problems are attacked 
(especially problems which require numerical integration for 
the function and gradient evaluations) . 

(3) In the early stages of the study, the effect of 
resetting to a gradient step every so many iterates was 
investigated.- On the problems considered herein it was not 
found to be helpful; in fact, it was found to be .. detrimental 
in the terminal stages of convergence because the H-matrix 
had to be rebuilt. Most of the example problems in the 
literature which get improved convergence with reset are of 
relatively low-dimension. (One theoretical advantage of 



reset is if it is included in any stable H-matrix type 
algorithm, then convergence can be proved for the same 
class of functions for which convergence can be proved 
for the gradient method.) 



4- OPTIMAL PARAMETER GUIDANCE 


Because of the success of the DFP algorithm in solving 
complicated Shuttle optimization problems, Ref. 11 proposes 
that the DFP algorithm rcay be useful for on-board guidance. 

A first approach to the problem is also presented in Ref. 11. 

In this section we shall demonstrate the technique of 
Ref. 11 on a simple example, and reference some of the technical 
literature which is relevant to the areas of optimal neighboring 
and parameter guidance. Recommendations and conclusions are 
presented in Section 3- 

Consider the following optimal control problem. 

Minimize: J = (4-1) 

Subject to: x^=u (0)=X2(0)=0 

x 2 =!xi 2 |u| < 1 , t f =2 (4-2) 

The optimal control may be determined by inspection as 


u (t) = 


-1 

0 


te r.o,i) 

t £ (1,2]. 


" (4-3) 

Since the optimal control is a sequence of piecewise constant 
segments, it satisfies the requirements of the Johnson-Kamm (J-K) 
guidance nominal control. The neighboring guidance function is 
U ( t) = cx 1 [U(0)-U(l)3 +e* 2 U(1), (4-4) 


where U (a) = 


5 i 


i 


o 


t > a 
t < a 


is the unit step function and o<^ 


0^2 are the constant controls on the intervals [0,1), (1,23, 
respectively. Of course, the values of ^ and ^ would be 
updated during each guidance cycle . 


17 
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Suppose (t , x 1Q3 x 20 ) , with t £ (0,1), is obtained by 
navigational measurements and (t , x^q, x ? q) is near some point 

■ft * 

(t ,x^ (t) ,x 2 (t) ) on the nominal trajectory. Given the control 
components , o< 2 (which we shall show how to calculate later), 
the final values of and x 2 are 

Xl (2) =^-,(1-t 0 ) + x 1Q + ^ 2 (2-1) (4.5) 

x 2 (2) = x 20 + to^ct-y + x 10 ] z dt 

+ x J ^ [ o( 2 (t-1) + x 10 + «^ 1 (1-t o )] 2 dt (4.6) 

Thus, the performance index is 

J(c<;x o ) = ix 2 (2) = -3 -^x 20 + -5-J I [ c*( ^ ( t — t Q ) + x 1Q ] dt 

+ iJ^:C^ 2 ( t Tl) + x 10 + «<i ( 1-t 0 )]2 dt} 2 (4.7) 


Reference 11 suggests that this function of the guidance • 
parameters should be minimized on the • ground before the flight 
to determine nominal values for c{, , 0( P (in this case, 

C^i = -1 ,c 7 2 = 0), and then form the linear feedback guidance 
functions " 


= °^1 + K 1l( t o)(Xio“ x l(t 0 )) + K 12^ t o' ) ^ x 20~ x 2^ t o^ 


0\ 2 - 0^21 + K 21 ^o^ ^ x 10 x 1 (t o )} + K 22^ t o^ x 20“ x 2^ t o^ » 


where t is the time of the navigational measurement with 
t [0,1). The nominal values o! 2 ) x^(t), x 2 (t), tS[0,2] 

and time varying gains K..(t), ts.[0, 1), t 6 (1 ,2] are stored 

- 1 * o 

on-board. As noted in Ref. 12, the choice of clock time, t , 
as the reference time in Eq. (4-8) is usually nonoptimal. Pro- 
cedures for determining the Mbest" index time are presented in 
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Ref. 12, e.g., the index time typically is the time on the 
reference trajectory which minimizes the state space distance 
between the measured state and nominal state trajectory. 

The neighboring optimal feedback gains K. . (t) are determined 
by expending the first-order necessary conditions for a minimum 
of J('X - , cK 2 ) • That is, define 


» 1^7 • e 2 Us';x 0 ) . 


(4-9) 


n 2 


On the nominal trajectory 

# # -if -X- 

;x Q ) = 0 , ;x q ) = 0 . 

From Sq . (4-7 ) , the expressions for g^ , gp are (assuming t Q £ [0,1)) 

Si ■ p 1 , * (_•••} tf ' ♦ *, 0 ](t-t 0 )dt 


+ J 2 [c 7 2 (t-D + c^O-t^ + x 10 3(1-t o )dt] 


(4-10) 


= — ~ f . . . 1 [ f 2 [#' (t-1) + ) + x 10 3(t-l)dt] 

^ 2 1 3 J 1 • (4.11) 


where ) . .. j is the bracketed term in Eq . ( 4 . 7 ). 


-X- * , 


Formally, the expansions of g^ and gp about ( a< , x Q ) are 

2 Si 


0..(« ; x„') IS f„ (d) XT) H- 21 




”1 
f 

V > i 


(cJ. ~cJ?) + ( (y- rX'V* < 


( 441 ) 


which implies (upon solution ford^, £{p): 



1 

/ v ~ 



r 



Xi. 

- r a ii .r 1 1 

jUx 

i. 



= 


l -3c(j\ J 



- 


a>io 

v 




v v 

A ?-0 ''7.5 


(4-13) 
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The existence of finite feedback gains is dependent upon the 
existence of an inverse for 

p _ C <' 

X — 4 * * £ ) 


a- _ t> --P 


which implies 


'3 ct ; i , 


ylll. + 


2- "P 


T 


■fclu "1 
- "2> 1 J 

Define 

(4-14) 

term of Eq. 

(4-7) . Then, 

P , 

^ 2 

(4.15) 

) z 

v? . if -J? ~ 

• 

DP 

7)^1 ~2> 

p vz , in \~ 
' T)^ + k * J 


(4.16) 

"oP 

As t — > 1 , P— >0, x^:;; — V 0 which implies the gains become 

»U 

infinite at the end of the constant control interval. 

In general, as noted in Ref. 11, the gains become infinite 
at each constant control interval endpoint . This is analogous 
to infinite gains at the terminal time in existing guidance schemes 
Since conservative allowances are made for the infinite-gain-at-t^ 
problem in existing guidance schemes, a similar procedure would 
be necessary for the guidance scheme of Ref. 11 at every constant 
central interval endpoint. Because of this the scheme would 
lose much of its optimality, and probably not be competitive 
with a physically based guidance scheme. 

Another aspect of the scheme is that its normality or 
controllability properties are probably poorer than existing 
schemes. For example, in the example problem of this section, 
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if t Q ~(l, 2 ] then only one control parameter ( ^ ^ ) is available. 
In a general problem where tight terminal boundary conditions are 
usually desired and the number of state variables is larger 

v 

than the number of control variables (the usual case), the 
terminal phase would not have enough control parameters to 
influence all of the terminal state variables. Thus, a modified 
terminal phase would probably be required. 

In Ref. 11 it is noted that a considerable amount of 
premission analysis would be required to compute the matrices 
required for the feedback gains because a forward integration 
of the differential equations for the matrices would be required 
from each guidance update time . Actually this computation can 
be reduced to a single backward integration by use of adjoint 
systems. That is, suppose 

X = A(t)X + B(t) , X(t Q ) = X Q ( 4 . 17 ) 

is the given matrix linear system. Define. 

T T 

z = -ZA (4.18) 

Then, 

~§t<:z T x) = z t b ( 4 . 19 ) 

or 

Z T (t*)X(t*) = Z T (t o )X(t o ) + J Z T (t)B(t)dt ( 4 . 20 ) 

Choosing ■ _ 

Z T (t*) = I, (4.21) 

and integrating ( 4 - 18 ) backward with the boundary condition 

(4-21) defines Z(t) . If the system is inhomogenous , .then one 

more backward integration is required to define J * Z T (t)B(t)dt. 

,, >0 

After these backward integrations, the matrix X(t.^) for an 
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. * *- 

arbitrary t £'Lt , is given by 

„ l-X- 

r, C 

X(tp = Z I (t o )X(t o ) + 'z T (t)B(t)dt. (4-22) 

0 

To conclude this section mention should be made of the 
optimal parameter guidance scheme of Ref. 13- In Ref. 1 3 > 
physically motivated parameters involved in analytical solutions 
for subarcs of the total trajectory are updated by use of the 
parameter conjugate gradient method on-board. Thus, use is made 
of an accelerated gradient technique on-board, and the conjugate 
gradient method was chosen because of less storage requirements 
with acceptable convergence properties. Even though the scheme 
of Ref. 11 was motivated by the excellent convergence properties 
of the DFP method in ground-based simulation, it does not employ 
DFP on-board. Furthermore, the only reason for associating the 
scheme with DFP is because the nominal trajectory is computed, 
with DFP. More will be said about this aspect in. Section 3. 



5- CONCLUSIONS AND .RECOMMENDATIONS 
5 . 1 Conclusions 

1. ) The modified Fletcher parameter optimization scheme 

is an effective scheme for trajectory optimization 
which does not require an elaborate 1 -D search. On 
well-behaved problems, DFP gave better performance, 
especially with respect to terminal convergence. 

The modified Fletcher method performed better on 
problems with ill-conditioned H-matrices. 

2. ) The Broyden method appears to be a promising new 

method. A related possibility is the Fletcher method 
with a 1-D search. All of these methods have been 
built into the NASA-MSC PEACE program. 

3-) It does not appear that accelerated gradient methods 
have progressed to the point where they would be 
useful for on-board optimal parameter guidance. For 
such applications, they need to be improved in three 
main areas: (i) elimination or near-elimination of 

the 1-D search, (ii) guaranteed rapid terminal con- 
vergence, and (iii) reduction of storage requirements 
(the conjugate gradient method already satisfies this 
requirement) . Since these areas are active research 
areas, improvements should be expected. 

4.) The neighboring optimal parameter guidance scheme 
proposed in Ref. 11 does not appear to be feasible 
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because of infinite gain and controllability problems, 
in addition to the usual restrictions of a neighboring 
optimal guidance scheme . 

3-2 Recommendations 

1 . ) Perform further simulations v/ith the Broyden and 

Fletcher (v/ith a 1-D search)' parameter optimization 
schemes. They should be especially effective on 
problems where the H-matrix is ill-conditioned. 

2.) Continue studying ways of eliminating the elaborate 
1-D search from accelerated gradient parameter 
optiroization schemes. This will hasten the use of 
these schemes in on-board guidance. 

3*) The guidance scheme in Ref. 13 represents a reasonable 
blend of physical based guidance and on-board parameter- 
optimization. It appears that this same idea may be 
applicable in reentry guidance. . For example, the 
guidance scheme proposed in Ref. 1^ is essentially a 
parameter guidance scheme with pieced subarcs of 
approximate analytical solutions. Thus, the possibility 
of adapting a parameter optimization scheme to the 
scheme should be investigated. 
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Iteration 
Numbe r 


Davicion-Fletche r-Powell 


Modified Fletcher 


No. of 
Function 
Evaluations 



. 13201 x 
. 10640 x 
. 10322 x 
. 98038 
. 21987 
. 14202 
. 84552 x 
. 84198 x 
. 84187 x 
. 84182 x 
.84181 x 


Search 
Pa ramete rs 


.646 x 1 0 
. 701 x 10' : 
.161 x 10 
• 440 , 

. 795 x 10' 

, 124 x 10 2 
. 876 x 10 1 
. 326 

. 198 x 10 3 
. 280 x 10 1 


| L , = - 8 % 

dci ! a =0 

79 x 10 4 
-. 90 x 10 1 
-. 68 x 10 1 
-. 37 x 10 1 
28 x 10 1 
21 x 10° 

28 x 10 " 4 6 
-. 61 x 10 
36 x 10' 7 
-.48 x 10 9 
79 x 10' 52 


No. of 
F unction 
Evaluations 


13201 x 10 1 
10913 x lo' 
10595 x 10* 
10480 x 10 1 
57441 
25564 

857 38 x 10‘J 
84427 x 10'’ 
84212 x 1 0~ : 
84206 x 10 
84204 x 10'’ 
84202 x 10" 


Sea rc’n 
Pararnete rs 


. 125 x 10 
. 312 x 10‘ 
. 156 x 10‘ 

. 195 
. 195 

. 438 x 10' 
. 763 x 10' 
477 x 10" 
298 x 10' 
596 x 1 0 
142 x 10" 



(43 minutes. Univac 1108; central differences) 


Used DFP formula (Eq. 3 . 3 ) TUsed Broyden formula (Eq. 3 ,4 ) 

Table 1. Stage -And-Half Configuration; Good Initial x Q . 


Iteration 

Gradient Method 

Number 

No. of 
Fn. 

Cost Eval. 


ppp Broyden 

(with search) (with search) 

No. of • [No. o: 

Fn. Fh. 


1611 
271.1 
54. 65 
13.04 
10. 83 
8.667 
7.736 
6 . 922 
6.438 
6.123 
6. 038 
5. 143 
3. 574 j 
2. 891 j 
2. 834 i 
2. 790 ; 
2. 718 ; 
2.457 j 
1 . 7 39 j 
1 . 7 27 


1611 1 
271.1 7 

13.75 4 

2.792 4 

1.311 4 

. 8897 4 

.2636 5 

.1621 4 

.1563 4 

.1554 4 

.1461 4 

.1183 4 

.1046 4 

.0972 4 

.0923 5 

.0888 4 

.0875 5 

.08553 6 

.08516 6 

. 08490 5 


1611 
271. 1 
13. 75 
2. 792 
1. 311 
. 8897 
. 2636 
. 1621 


.1563 4 

.1554 4 

.1461 4 

.1183 4 

.1045 4 

. 0967 4 

.0921 5 

.0886 4 

.0873 5 

.08551; 5 

.08508; 6 

.08485; 4 


Modified Fietchei 

No. of 
Fn. 

Cost Eval- 

1611 . 1 
397.7. 10* 

34.64 5 t 

32.24 7* 

30.95 3* 

8.795 3 t 

6.003 3 1 

5.968 3 j 

3.123 3* 

2.631 3 1 

2.420 3 1 

2. 205 3* 

. 8923 4 1 

.5323 3* 

.3663 3* 

.3252 3 1 

.3092 3 1 


DFP Broyden 

(crude search) (crude search) 
No. of No. of 

Fn. Fn. 

Cost Eval _ Cost Eval. 


1611 
397. 7 
34. 64 
32. 27 
28. 31 
7. 948 
5. 571 
4. 809 
3. 429 
2. 850 
2. 749 
1. 815 
1. 528 
. 4339 
. 3741 
. 3619 
. 3485 


1611 
397. 7 . 

63. 07 
30. 72 
16. 58 
7. 395 
4. 426 
3.422 
3. 241 
2. 388 
2. 123 
.4776 
.4309 
. 3682 
. 3238 
. 3104 


(10 min. , Univac 1108; forward differences) 


Univac 1108: forward differences) 








Iteration 

Number 


1. 058 
1. 058 
1.057 
1.056 
1. 056 
1. 053 
1.050 
1. 024 
1. 001 



Davidon- Fletcher -Powell 

Number of j 

Function Search ] 
Evaluations Parameter 

1 

4 . 25 x 1 0 4 

5 .95 x 10 * 

26 . 35 x 10"’ 

37 .68 x 10 

30 . 10 x 10 1 

5 .53 , 

9 i .93 x 10 

6 . 84 x 10 1 

5 .68 x 10 1 

7 .21 x 10 2 

7 . 16 x 10 1 

5 .44 x 10 1 

5 .94 x 10 1 

22 . 10 x 10 8 


Modified Fletcher 


.3x10 
,9 x 10 1 
. 1 x 10 2 J 

• 1 x 10 "z 

■ 4 x 10 -> 

.4x10 

. 3 x 10, 
.3 x 10" 

. 3 x 10 
. 2 x 10 ‘ 
. 1 * 10 "^ 
.6x10 
. 2 x 10" 


Univac 1108; central differences ) 


<=Used DFP formula (Eq. (3.3). 


Cost 

1.058 
1.058 
1. 057 
1. 057 
1. 056 
1.056 
1. 033 
1.029 
.9816 
. 9751 
.9607 
.9554 


Number of 
Function 
Evaluations 


Search 

Parameter 


. 12 x 10" 
.78 x 10" 
.78 x 10" 
.48 x 10~ 
. 95 x 10" 
. 24 x 10" 
. 12 x 10" 
. 12 x 10" 
. 12 x 10* 
.12 x 10' 
.12 x 10' 


(7 min. , Univac 1108; central 
differences) | ! 


tUsed Broyden formula (Eq.3. 4 ) 


Table 3. Ascent Problem with H-Matrix Tending to Singularity in DFP Method. 




